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DETAILED ACTION 

Response to Arguments 

In view of the Appeal Brief filed on 11/11/09, PROSECUTION IS HEREBY 
REOPENED. A new ground of rejection is set forth below. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1.111 (if this Office action is non-final) or a reply 
under 37 CFR 1.113 (if this Office action is final); or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41 .20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 



(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1 . Claims 1 -1 5 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi") in view of Tyler 
(5765043). 

Regarding claim 1, Sankrithi discloses an apparatus that relates to 
airplane ground maneuvering systems (Sankrithi: column 1, lines 12-13). This 
apparatus comprises "at least one sensor operable to capture images 
representing scenery outside the vehicle" (Sankrithi: column 3, lines 53-55, 
wherein the sensor is the camera), "a protective housing enclosing the sensor, 
wherein the housing further comprises a transparent aperture through which the 
sensor captures images" (Sankrithi: column 9, lines 1-15, wherein the aperture is 
the clear lens), "a cleaning mechanism operable to remove obstructions from the 
aperture without interfering with the field of view of the sensor" (Sankrithi: 
column 9, lines 1-32, wherein the window cleaning is the cleaning mechanism), 
"a surface that rotates along the axis of the surface" (Sankrithi: figures 10-11) 
and "an operator display through which images representing the scenery outside 
the vehicle are displayed" (Sankrithi: figure 6A). However, Sankrithi fails to 
disclose the rotating conical surface as claimed. Tyler teaches that prior art 
camera systems provide an undesirable slant angle of the window relative to the 
camera (Tyler: column 2, lines 45-53). To help alleviate this problem, Tyler 
discloses "a conical surface that rotates about a drive shaft along the axis of the 
conical surface" (Tyler: figures 2-6). The examiner notes that while Tyler's 
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camera system appears to be spherical in shape, the use of a spherical or 
conical shape is simply a matter of design choice. Hence one of ordinary skill 
can easily select between the different shapes depending on the different 
parameters associated with the camera's environment. Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was 
made to take the apparatus disclosed by Sankrithi and add the conical surface 
taught by Tyler in order to obtain a surveillance system that does not limit the 
camera movement. 

Regarding claim 2, Sankrithi discloses "wherein the sensor comprises a 
camera" (Sankrithi: column 3, lines 53-55). 

Regarding claim 3, Sankrithi in view of Tyler disclose "wherein an outer 
surface is wiped within the housing to remove obstructions" (Sankrithi: column 9, 
lines 10-15, wherein the wiping is performed by the rubbery squeegee; (Tyler: 
column 2, lines 45-53). 

Regarding claim 4, Sankrithi discloses "the cleaning mechanism is located 
to not obstruct the sensors field of view" (Sankrithi: figure 11; column 9, lines 1- 
15, wherein the wiper housing 452 is mounted to the plane away from the 
camera). 

Regarding claim 5, Sankrithi discloses "the camera further comprises an 
infrared camera" (Sankrithi: column 13, lines 43-46). 

Regarding claim 6, although not disclosed, it would have been obvious for 
the cleaning mechanism further comprises a mechanical brush (Official Notice). 
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Doing so would have been obvious in order to effectively clean all debris from the 
surface. 

Regarding claim 7, Sankrithi discloses "the cleaning mechanism 
comprises a cleaning fluid applicator that applies cleaning solution to the 
aperture" (Sankrithi: column 9, lines 10-15, wherein the cleaning solution is the 
combination of the air mixed with water, antifreeze, or cleaning solution). 

Regarding claim 8, note the examiners rejection for claim 1, and in 
addition Sankrithi discloses "images representing scenery outside the vehicle are 
derived from captured images from the sensor" (Sankrithi: column 3, lines 53-55, 
wherein the camera derives the images). 

Regarding claim 9, note the examiners rejection for claim 2. 

Regarding claim 10, Sankrithi discloses "the vehicle comprises an aircraft" 
(Sankrithi: column 3, lines 44-47). 

Regarding claim 1 1 , note the examiners rejection for claim 5. 

Regarding claim 12, note the examiners rejection for claim 6. 

Regarding claim 13, note the examiners rejection for claim 7. 

Regarding claim 14, note the examiners rejection for claim 1, and in 
addition, Sankrithi discloses "sending images of a portion of the out-the-window 
scene from the viewpoint of the sensor" (Sankrithi: figure 6A, wherein the 
images are sent to the display) and "outputting image of the scenery outside the 
vehicle to a first display, wherein the display device is positioned to provide the 
portion of a desired out-the window visual scene in combination with a window 
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that provides another portion of the desired out-the-window visual scene" 
(Sankrithi: figure 6A, wherein multiple views are displayed to the user). 

Regarding claim 15, although not disclosed, it would have been obvious to 
mount the second camera within a protective housing (Official Notice). Doing so 
would have been obvious in order to protect the camera against the influence of 
outside elements. 

2. Claims 1 6-33 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi") in view of Tyler 
(5765043) in further view of Jamieson et al. (6665063), (hereinafter referred to as 
"Jamieson"). 

Regarding claim 16, note the examiners rejection for claim 1, and in 
addition, claim 16 differs from claim 1 in that claim 16 further requires fusing two 
image together. Jamieson teaches that for manned aircraft, collisions with 
ground and air based obstacles results in numerous fatalities each year 
(Jamieson: column 2, lines 32-35). To help alleviate this problem, Jamieson 
discloses "images from the first and second sensor are fused to create a first 
fused image" (Jamieson: figures 13A and 14A, wherein the images are fused or 
combined to produce the output image). Therefore, it would have been obvious 
to one having ordinary skill in the art at the time the invention was made to take 
the apparatus disclosed by Sankrithi and add the processing taught by Jamieson 
in order to obtain an apparatus that helps prevent aircraft collisions. 
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Regarding claim 17, Jamieson discloses "combining the fused image with 
symbols representing objects" (Jamieson: figures 13A and 14A, wherein the 
symbols are the circles and lines representing objects). 

Regarding claim 18, Jamieson discloses "fusing the first fused image with 
an enhanced image from at least one of RADAR and a FLIR sensor" (Jamieson: 
column 16, lines 5-10). 

Regarding claim 19, note the examiners rejection for claims 1 and 14, and 
in addition Sankrithi in view of Jamieson disclose "transform the first sensor 
image to a viewpoint image from an operator station in the device, wherein the 
viewpoint image is seized and oriented to conform to the scenery outside the 
device from the operator station" (Sankrithi: figures 16A and 16B, wherein the 
image is defined within the field of view and oriented to fit the display; Jamieson: 
figures 13A and 14A). 

Regarding claim 20, Jamieson discloses "the symbols represent 
information regarding the operation state of the device and the moving objects 
detected in the image" (Jamieson: column 16, lines 25-30, wherein the operation 
state information is the velocity, speed, and heading; column 16, lines 31-35, 
wherein the distance to the object is displayed). 

Regarding claim 21 , note the examiners rejection for claim 20. 

Regarding claim 22, although not disclosed, it would have been obvious to 
generate a symbol representing weather hazards (Official Notice). Doing so 
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would have been obvious in order to more easily warn the pilot of adverse 
weather conditions. 

Regarding claim 23, Jamieson discloses "receive an enhanced image in 
low-visibility conditions" (Jamieson: column 16, lines 5-10, wherein the RADAR 
or FLIR provide the image in low-visibility conditions). 

Regarding claim 24, Jamieson discloses "fuse the viewpoint image with 
the enhanced image" (Jamieson: figures 13A and 14A). 

Regarding claim 25, Jamieson discloses "utilize data from a position 
sensor to determine the location of the objects" (Jamieson: column 16, lines 31- 
35, wherein the location of the object is determined with respect to the aircraft). 

Regarding claim 26, Jamieson discloses "utilize data form off-board data 
sources regarding the objects" (Jamieson: figure 36, wherein the 
transmit/receive fiber bundles receive off-board data). 

Regarding claim 27, note the examiners rejection for claim 2. 

Regarding claims 28-29, Jamieson discloses the sensor is a RADAR and 
FLIR sensor" (Jamieson: column 16, lines 5-10). 

Regarding claim 30, Sankrithi discloses "generate a common display area 
associated with two mutually exclusive windows of information on the display 
device, the area being customized by the operator to display detailed 
information" (Sankrithi: figure 6A; column 6, lines 23-25, wherein the knob 
adjusts the displays). 
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Regarding claim 31, note the examiners rejection for claims 1,14, and 15, 
and in addition Sankrithi discloses "first and second display devices" (Sankrithi: 
figure 6A), "outputting the two viewpoints to the first and second display devices" 
(Sankrithi: figure 6A). 

Regarding claim 32, Jamieson discloses "combining the image with 
symbols representing the objects and primary flight information" (Jamieson: 
column 16, lines 25-30, wherein the primary flight information is the velocity, 
speed, heading, and power levels). 

Regarding claim 33, note the examiners rejection for claim 18. 
Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DAVID CZEKAJ whose telephone number is (571)272- 
7327. The examiner can normally be reached on Mon-Thurs and every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Dave Czekaj/ 

Primary Examiner, Art Unit 2621 



